Sampling from log-concave non-smooth densities, when Moreau meets Langevin∗

نویسنده

  • Eric Moulines
چکیده

In this talk, a new algorithm to sample from possibly non-smooth log-concave probability measures is introduced. This algorithm uses Moreau-Yosida envelope combined with the Euler-Maruyama discretization of Langevin diffusions. They are applied to a deconvolution problem in image processing, which shows that they can be practically used in a high dimensional setting. Finally, non-asymptotic convergence bounds (in total variation and wasserstein distances) are derived These bounds follow from non-asymptotic results for ULA applied to probability measures with a continuously differentiable log-concave density. [A paper will be arxived soon (updating http://arxiv.org/abs/1507.05021).]

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlo

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (2016) when applied to log-concave probability distributions that are restricted to a convex body K. This method relies on a regularisation procedure involving the Moreau-Yosida envelope of the indicator function associated with K. Explicit convergence bounds i...

متن کامل

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when...

متن کامل

Further and stronger analogy between sampling and optimization: Langevin Monte Carlo and gradient descent

In this paper, we revisit the recently established theoretical guarantees for the convergence of the Langevin Monte Carlo algorithm of sampling from a smooth and (strongly) log-concave density. We improve the existing results when the convergence is measured in the Wasserstein distance and provide further insights on the very tight relations between, on the one hand, the Langevin Monte Carlo fo...

متن کامل

User-friendly guarantees for the Langevin Monte Carlo with inaccurate gradient

In this paper, we revisit the recently established theoretical guarantees for the convergence of the Langevin Monte Carlo algorithm of sampling from a smooth and (strongly) log-concave density. We improve, in terms of constants, the existing results when the accuracy of sampling is measured in the Wasserstein distance and provide further insights on relations between, on the one hand, the Lange...

متن کامل

Mirrored Langevin Dynamics

We generalize the Langevin Dynamics through the mirror descent framework for first-order sampling. The näıve approach of incorporating Brownian motion into the mirror descent dynamics, which we refer to as Symmetric Mirrored Langevin Dynamics (S-MLD), is shown to connected to the theory of Weighted Hessian Manifolds. The S-MLD, unfortunately, contains the hard instance of Cox–Ingersoll–Ross pro...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016